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Abstract 

We propose a sequential optimizing betting strategy in the multi-dimensional 
bounded forecasting game in the framework of game-theoretic probability of Shafer 
and Vovk (2001). By studying the asymptotic behavior of its capital process, we 
prove a generalization of the strong law of large numbers, where the convergence 
rate of the sample mean vector depends on the growth rate of the quadratic variation 
process. The growth rate of the quadratic variation process may be slower than the 
number of rounds or may even be zero. We also introduce an information criterion 
for selecting efficient betting items. These results are then applied to multiple 
asset trading strategies in discrete-time and continuous-time games. In the case of 
continuous-time game we present a measure of the jaggedness of a vector- valued 
continuous process. Our results are examined by several numerical examples. 

Keywords and phrases: game-theoretic probability, Holder exponent, information crite- 
rion, Kullback-Leibler divergence, quadratic variation, strong law of large numbers, uni- 
versal portfolio. 



1 Introduction 

Since the advent of the game-theoretic probability and finance by Shafer and Vovk [TO] , 
the field has been expanding rapidly. The present authors have been contributing to 
this emerging field by showing the essential role of the Kullback-Leibler divergence for 
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the strong law of large numbers (SLLN) [U |9] and by proposing a new approach to 
continuous-time games |12l[T3]. Our approach to continuous-time games has been further 
developed by V. Vovk [H [151 [I6]. 

In this paper we propose a sequential optimizing betting strategy for the multi- 
dimensional bounded forecasting game in discrete time and apply it as a high-frequency 
limit order type betting strategy for vector-valued continuous price processes. 

Our strategy is very flexible and the analysis of its asymptotic behavior allows us to 
generalize game-theoretic statements of SLLN to a wide variety of cases. SLLN for the 
bounded forecasting game is already established in Chapter 3 of [TU]. In [S] we gave a 
simple strategy forcing SLLN with the rate of 0{^/]ogn/n), where n is the number of 
rounds. However the convergence rate of SLLN should depend on the growth rate of the 
quadratic variation process. For example, in view of Kolmogorov's three series theorem 
(e.g. Section IV. 2 of [H]), the sum s„ = Xi + ■ ■ ■ + x„ G of centered independent 
measure-theoretic random variables converges a.s. if the sum of their variances converges 
(i.e. ^„ Var(a;„) < oo). Therefore in this case the sample average Xn = Sn/n is of order 
0{l/n). By our sequential optimizing betting strategy, we can give a unified game- 
theoretic treatment on the asymptotic behavior of s^, which depends on the asymptotic 
behavior of X]r=i ^1 as n — > oo. 

The strength of our results can be seen when we interpret our results in the standard 
measure-theoretic framework. Let s„ = xi + ■ ■ ■ + Xn he a. one-dimensional measure- 
theoretic martingale w.r.t. a filtration {J-'n} with uniformly bounded differences < 1, 
a.e. Let Vn = xl+- ■ ■+xf^. Then with probability one the sequence -y/ max(0, Vn log Vn), 

= 1, 2, . . . , is bounded. See Proposition 12.11 below. Note that in this statement no as- 
sumption is made on the growth rate of Vn- The rate itself may be random. 

From more practical viewpoint, our sequential betting strategy is very simple to imple- 
ment even for high dimensions and shows a very competitive performance when applied 
to various price processes. In Section [6] we compare the performance of our strategy with 
the well-known universal portfolio strategy developed by Thomas Cover and collaborators 
( [S m El E] ) . The performance of our sequential betting strategy is competitive against 
the universal portfolio. Note that the numerical integration needed for implementing 
universal portfolio is computationally heavy for high dimensions. 

When we can bet on a large number of price processes, it is not always best to form 
a portfolio comprising all price processes, because estimating the best weight vector for 
the price processes might take a long time. By approximating the capital process of our 
sequential optimizing strategy, we will introduce an information criterion for selecting 
price processes in a portfolio. 

The organization of this paper is as follows. In Section [2] we formulate the multi- 
dimensional bounded forecasting game, introduce our sequential optimizing strategy and 
state our main theoretical result. In Section [3] we give a proof of our result by analyzing 
asymptotic behavior of its capital process. We also introduce an information criterion for 
selecting efficient betting items. These results are then applied to multiple asset trading 
games in Section |H In Section HI we formulate the multiple asset trading game in con- 
tinuous time and based on high-frequency limit order type betting strategies we present 
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a measure for the jaggedness of a path of a vector- valued continuous process. In Section 
O as indicating the generahty of our results, we provide a multiple type of Girsanov's 
theorem for geometric Brownian motion and an argument concerning the mutual infor- 
mation quantity between betting games. In Section [H] we give numerical results for several 
Japanese stock price processes. We conclude the paper with some remarks in Section [71 

2 A sequential optimizing strategy and its implica- 
tion to strong law of large numbers 

We treat the following type of discrete time bounded forecasting game between Skeptic 
and Reality. JCq is the initial capital of Skeptic, D is a compact region in such that 
its convex hull coZ^ contains the origin in its interior, and ■ denotes the standard inner 
product of M°'. 

Discrete Time Bounded Forecasting Game 
Protocol: 
/Co := 1. 

FORn= 1,2,...: 

Skeptic announces M„ G M*^. 
Reality announces x„ G -D. 

/C„ = JCn-l + Mn ■ Xn- 

END FOR 

In this paper we regard d-dimensional vectors such as Xn = (x^, . . . ,x'^y as column 
vectors with * denoting the transpose. = a/x*x = y/x ■ x denotes the Euclidean norm 
of X. Letting a„ = M„//C„_i, we can rewrite Skeptic's capital as /C„ = /C„_i(l + a„ • 
Xn), Oin G M'^. In the protocol, we require that Skeptic observes his collateral duty, in the 
sense that /C„ > for all n irrespective of Reality's moves xi,X2, ■ ■ ■ ■ 

For constructing a strategy of Skeptic, consider that Skeptic himself generates 'training 
data' x_„Q+2, . . . , Xq} of size no > d+1. This operation is similar to a construction 

of a prior distribution in Bayesian statistics, where a prior distribution can be specified 
by a set of prior observations. Throughout this paper we fix an arbitrarily cq G (0, 1) and 
choose the training data . . . , xq} in such a way that 

1 + a ■ Xn > 0, n = —riQ + 1, . . . , 0, =^ 1 + a ■ x > eo, Wx E D. (1) 

Let P^^ = {a \ 1 + a ■ Xn > 0, n = —no + 1, . . . , 0}. Then ([1]) is equivalent to 

<,.oC-(l-eo)(coD)^ 

where (coD)-^ denotes the convex dual of coD. For example, for d = 1 and D = [—1, 1], 
we can take x_i = 1/(1 — eo) and Xq = —1/(1 — eo). Then a has to satisfy |q;| < 1 — eo 
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and the right-hand side of ([T]) holds. For general C M'^ let 5 = max^^gD ||x|| and let 
c = 5\fd/ (1 — Co). Then we can take tlq = 2d training vectors as 

(0,...,0,±c,0,...,0)\ 

where c is in the z-th coordinate {1 < i < d). Then each element a\ 1 < i < of 
a = {a^, . . . ,a'^y has to satisfy \a^\ < 1/c and ||a|| < (1 — eo)/S. Hence the right-hand 
side of (lH) holds by Cauchy-Schwarz inequality. It should also be noted that ([T]) implies 
that the training vectors span the whole W^. 

The strategy with a constant vector q;,^ = a G M*^ is called a constant proportional 
betting strategy. For > we define 

TV 

^o,7v(a) = ^og{l + a-Xn), (2) 

n=— no+l 

which is the log capital at round under the constant proportional betting strategy, 
including the training data. We add '0' to the subscript to indicate that the training data 
are included in a summation. Since the game starts at time 1, actually the log capital of 
the constant proportional betting strategy is $o,Ar(«) — $o,o(«) = S^=i log(l + « • Xn)- 

Let us consider the maximization of $o,Af(«) with respect to a G M.'^. The maximum 
corresponds to the log capital at time of a 'hindsight' constant proportional betting 
strategy. Note that $o,Af(«) is a strictly concave function of a. The condition ([T]) ensures 
that the maximum of ^o,n{c() is attained at the unique point a = in the interior of 



Pno,eo SO that 



da 



From numerical viewpoint we note that the numerical maximization of $o,Af('^) is straight- 
forward even in high dimensions. 

We now define sequential optimizing strategy (SOS) of Skeptic, which is a realizable 
strategy unlike the hindsight strategy. It is given by 

On = n > 1. (4) 

The idea of SOS is very simple. We employ the empirically best constant proportion until 
the previous round for betting at the current round. Note that SOS depends on the choice 
of the training data. Skeptic's log capital log/C*jY at round N under SOS is written as 



N 



n=l 



Let ^ = X1X2 ■ ■ ■ G -D°° denote a path, which is an infinite sequence of Reality's moves. 
The set fl = D°° of paths is called the sample space and any subset ii^ of f2 is called an 
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event. = xi . . . x„ denotes a partial path of Reality until the round n. A strategy V 
specifies a„ in terms of i.e. a„ = The capital process under V is given as 

^iN — n!^=i(l + ■ ^n)- 'P is called prudent, if Skeptic observes his collateral duty 

by V-i i.e. /Cf^ > 0, VA^ > 0, irrespective of Reality's moves Xi,X2, .... In this paper 
we only consider prudent strategies of Skeptic. We say that Skeptic can weakly force an 
event E d VLhy a. strategy V if lim supjy ^'i n = ^ fo'^ every ^ ^ E. As in Section [1] we 
write 

Sn = Xi + h Xat G M*^, Vn = Xix\ + ■ ■ ■ + Xnx\ {: d x d). (5) 

Then trVAr = ^^=\_ ll^^nP- We are now ready to state our main theorem. 
Theorem 2.1. By the sequential optimizing strategy Skeptic can weakly force 

E : lim sup — ^ < oo. (6) 

N iy/max(l, tr V^r log(tr Vat)) 

The maximum in the denominator is needed only for the case that sup^ytrVAr < 1, 
such as G -D and Reality always chooses x„ = 0. It is important to emphasize that 
E in is weakly forced irrespective of the rate of growth of tr V^r, including the zero- 
growth case, i.e. the case that trVAr converges to a finite value. A measure-theoretic 
interpretation of our result shows the fiexibility of our result. When XnS are measure- 
theoretic martingale differences, then the capital process under SOS is a non-negative 
measure-theoretic martingale, which converges to a finite value almost surely. Therefore 
as in Chapter 8 of [_10j we have the following proposition. We use the same notation as 
above. 

Proposition 2.1. Let s„ = Xi + ■ ■ ■ + a;„ be a d- dimensional measure-theoretic martingale 
w.r.t. a filtration Assume that the differences Xn ^ D are uniformly bounded a.e.. 

Then with probability one the sequence ||s„||/ A/max(l, tr Vn log(tr Vn)), n = 1,2, zs 
bounded. 

Let Ainax.AT and Amin^Ar dcuotc the maximum and the minimum eigenvalues of Vn- 
Consider the event 

E' : lim 1^1^^ = 0. (7) 

Theorem 12.11 gives only the order of sn- If we condition the paths on the event E', then 
we can derive a more accurate numerical bound as follows. 

Theorem 2.2. By the sequential optimizing strategy Skeptic can weakly force 

7-1/ ^ r ■sJvV^'^Stv ^ 

E =^ lim sup - — T77~r ^ 1 ■ 

N loglVTvl 

This theorem follows from the fact that on E' Skeptic can weakly force a*^ — > 0, as 
shown in the proof of this theorem in Section 13.41 
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Note that Amin.Af ^ C)0 on E'. Note also that in ([6]) holds if and only if limsup^ ll-^Af 11/ 
^y max(l, Amax,Ar log Amax.Af) < oo, because Amax,Ar < ti Va^ < c^Amax.AT- Hence on E' we 
have 

1 > hmsup — > hmsup — . 

N log I Vat I AT "Amax,Ar log Amax,Af 

Therefore, although we only have a conditional statement in Theorem 12.21 it gives a more 
accurate numerical bound than Theorem I2.1[ 

3 Proof of the theorem and some other results on 
sequential optimizing strategy 

In this section we provide proofs of the above theorems and present other results on 
the sequential optimizing strategy. For readability, we divide the section into several 
subsections. 



3.1 Properties of a*j^ and the empirical risk neutral distribution 



Let Sx denote a unit point mass at x G M'^ and let = J2n=-no+i ^^n/i^ + '^o) denote 
the empirical distribution of the training data and Reality's moves xi, . . . , xat up to round 
N. In view of ([3]) we define the empirical risk neutral distribution up to round by 



1 ^ A 



For notational simplicity we omit '0' from the subscript of and (7^, although they 
involve the training data, g^j is indeed a probability measure, because by ([3]) we have 



where the summation on the left-hand side is over distinct values of Xn-, n = — no+1, . . . ,N. 
By we denote the expected value under g^^. Then ([3]) is written as Eg^^lx] = 0. 

The log capital log ]Cqj^ = $o,Ar(«Ar) of the constant hindsight strategy up to round 
N including the training data is expressed as 

log^^ = $o,7v(«^) = (iV + no)^^iv(K})log ^fi|'^"|| = {N + no)D{g^\\g%), (8) 

where D^g^Wglf) denotes the Kullback-Leibler divergence between two probability distri- 
butions giy and (7^. 
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Now note that log{l+a^_i-Xn) = $n(a.!^_i) — *^'n-i(an-i)- By summation by parts, the 
difference log^Q^^ — log/CJ^^ between the hindsight strategy and SOS can be expressed 

as 



N 



log^*,^ - log/Ct,^ = ^ + $o,o(«o), (9) 



n=l 



where A$„, = $„(«*) — > and $0,0(^0) ^ constant depending only on the 

training data. We will analyze the behavior the log capital log/C^^ of SOS by analyzing 

log£S,7vandElo^*- 
We call 



1 1 ^ t 



n=— 710+1 



the empirical risk neutral covariance matrix for Reality's moves up to round A^. Write 

1 



^ 1 

S0,N = E] "^0'^ ~ "^O'^' 



n=— no+l 

Noting 5'Ar({x„,}) = (1 + ■ Xn)5f;^({a;„}), we have 

xo,N = Eg^[x] = Eg*J{l + a*N ■ x)x] = Eg*Jx] + Eg*Jxx']a*N = Eg*Jxx']a*N. 
Therefore is expressed as 

"at = Vn'^Xq^N = Voj/'So^N- (10) 

Since itself contains a^, ffTOj) does not give an explicit expression of a^. However it 
is a very useful exact relation for our analysis. 

We now consider Aa* = a* — On-i- the following we use the notation 

Xn{a) 



1 + a ■ Xn 

Taking the difference of the following two equalities 

n n— 1 

i=— no+l i=— no+l 

we obtain 

fa! 1 - a!) ■ x,- 



0= V X ^^n-i-^nJ---i + ^(a*) 
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Therefore 

n—l ^- 

Note that the denominator on the left-hand side is a scalar and the matrix on the left-hand 
side is positive definite. Then 



Aa; = Vo,„-i «_!,«*) x„«), (11) 



where = Y17=-no+i Xiia)xi{l3y. 

Concerning the behavior of Aa* we state the following lemma, which will be used in 
Section I3.4[ 

Lemma 3.1. lim„ Aa* = for every ^ G D°° . 
We give a proof of this lemma in Appendix. 

3.2 Bounding the difference between the hindsight strategy and 
SOS from above 

We now give a detailed analysis of X]^=i A$„ on the right-hand side of ([9]) and bound it 
from above. We note the following simple fact on A$„: 

A$„ = = <|.„_lK)-$„_lK_l)+ log ^ ^ " 



1 -|- 0!^_^ • Xn 

< log = log (1 + ' (12) 

where the inequality holds since ajlj.i maximizes $„_i(q;). Substituting ffTTj) into the 
right-hand side we obtain 

A$„ <log(l + x„«)Vo,„„iK_i,0-V„K„i)). (13) 

Note that we can also rewrite 

1 + Vo,n-i(a„_i, ttn) a;„(a„_ J = — — —, (14) 

where we used a well-known relation between determinants (e.g. Corollary A. 3.1 of [T]). 
Let 

Ci = max ( sup (l + a-x), sup (l + a-Xn)), (15) 

a6-(coZ))-l-, xGD -no+l<n<0 

which is a constant depending only on the training data. The first argument Ci^o = 
sup„£_(coD)i, a;eD(l + en ■ x) ou the right-hand side of ( fT5|) corresponds to the maximum 
one-step growth rate of Skeptic's capital under the collateral duty and Ci^ equals 2 if 
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D is symmetric w.r.t. the origin. Ci^ may be large if D is highly asymmetric w.r.t. the 
origin. For example, for = 1 and D = [—0.1, 1], we have Ci_o = 11. 

For two symmetric matrices A, B, let A> B mean that A — B is non-negative definite. 
Then 

1 

Cf 

where Vo,n-i = Vo,n-i(0, 0) = XlIL-no+i ^i^l- Note that Vo,n-i is positive definite because 
of the training data, although Vn-i in ([5]) may be singular. Note also that 1 + -Xn > €o 
for m,n > 1. Therefore 

^0 

Hence we can bound 

N N 



n=l n=l 

Write a„ = x)^VQ^_iXn > 0. Note that 1 + a„ = | Vo,„|/| Vo,„_i|. Also for c > 1 and a > 
we have 1 + ac < {1 + aY and hence 

log(l + ac) < clog(l + a). 

Therefore 

^ ^ W \ 

V log(l + C2an) < C2 V log(l + an) = C2 log 

n=l n=l I^O'Ol 

Now we have proved the following lemma. 

Lemma 3.2. The difference ^^^^ A$„ on t/ie right-hand side of ^ is hounded from 
above as 

N 

5^A$„ < C2(log|l^o,7v| -log|l^o,o|). 

n=l 

Since | Vo,Ar| involves the training data, for simplicity in our statement we further bound 
it as follows. By the inequality between the geometric mean and arithmetic mean we have 
\Vo,n\^''^ < tTVo,N/d. Hence 

log I Vo^N I < d log tr Vo,Ar — d log d = d log(tr V^v + tr Vo,o) — d log d 
< rflog(trV7v + tr\/o,o)- 

If trVAT < 1, then log(trVAr + tr\/o,o) < log(l + trK),o) < tr Vo,o. On the other hand if 
trVAT > 1, then 

log(tr IV + tr K),o) = logtr IV + log(l + < logtr \V + 

tr Kjv tr V]sf 

< logtrlV + tr\4),o- 

Therefore for both cases log|Vo,Af| < (imax(0, logtr Vat) +c?tr Vo,o- Let C3 = C2((itrVo,o — 
log |Vo,o|)- In summary we have the following bound. 
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Lemma 3.3. The difference J2n=i on the right-hand side of ^ is bounded from 
above as 



N 



^A<l>„ < dC2max(0,logtrV5v) + 6^3, (16) 



n=l 



where 6*2; C*3 depend only on the training data. 

Note that f|T6l) is true even for the case that hniTvtr Vat < oo. Note also that log tr Vat 
is of order O(logA^) even for Vn = 0{N'^), < 7 < 1. However for trV/v = logA^ we 
have log tr Vn = log log A^. 

3.3 Bounding the hindsight strategy from below 

In this subsection we bound the hindsight strategy from below and thus finish the proof 
of Theorem 12. 1[ 

Consider the function (1 + t) log(l + t),t> —1. By Taylor expansion we have 
(l + t)log(l + t)=t+i^^, 0<^^<1. 



By the definition of Ci in f[T5|l we have 

(a* ■ X 1^ 

{l + a%- Xn) log(l + a*j^ ■ Xn) >a*j^-x^+ ^ , VA^ > 1, -no + 1 < Vn < N, 

and 

N 



*o,7v(a^) = ^ (1 + ■ Xn) log(l + a*^ ■ x^) \ 

n=— no+1 

a*j^ ■ Xn 1 ( 

n=— jiQ+l n=— riQ+l " 

_ \^ [aj^-Xn] 

Ci ^ I 

n=— nn + l 



2Ci ^ 1 + ■ x„ ' 

-no+l 



(17) 



where we have used the fact Eg*^\x\ = 0. By (ITOl) the summation on the right-hand side 
can be written as 

E(q;^ ■ x„) ^ ^ ^*t„ „t T/*-i„ /'1o^ 

n=-no+l ^ + OiN-^n 

In analyzing the behavior of (fT8|) we need to be careful about the following fact: 
1 + alf ■ Xn, n < 0, may be arbitrarily close to zero for the training data x_no+iy ■ ■ ■ ,Xo. 
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In particular we might have different behavior between eigenvalues of V^*^ and and those 
of Vat. To assess the effect of training data let 







n=— rao+l 



and define the following event 



Li : limsup — < oo. 

AT max(0, logtr VV) 

Again max is needed only for the case that tr V^v < 1 for all A^. We now show that Skeptic 
can weakly force Ei. Fix an arbitrary ^ G E^, where E^ denotes the complement of Ei. 
Then limsup^ Ajq / max(0, log tr Vat) = oo and hence there exists some ni < such that 

l/(l + a^-a;„J 

limsup — = oo. 

N max(0, logtr Vat) 

Then there exits a subsequence of rounds Ni < N2 < ■ ■ ■ such that 

1/(1 + a^, ■ a^nj 
lim — - — - — — — - = 00. 

k max(0, log tr Vn^ ) 



Because a*^^ ■ x„j ^ — 1 we have 



2 



limsup — f = 00. 

N max(0, log tr Vn) 



If we compare this with the left-hand side of (JTSll . we see that a single term of the 
training data contributes arbitrary large gain to Skeptic in comparison to the right-hand 
side of f|T6|) . This implies that lim sup^ log /C]' ^ = 00. We have proved that by SOS 
Skeptic can weakly force Ei. Therefore from now we only consider ^ G -Ei. 

At this point we distinguish two cases 1) E2 : lim^r tr < 00 or 2) ii^2 • liiiiiv tr Vn = 
00. Consider the first case and fix an arbitrary ^ G E2 Ci Ei. For such a ^ there exists 
6{^) > such that liminfiv(l + ■ Xn) > 5(0 n < 0. Then 

1 ^ 
maxleo, c)(c)) , 

and hence the maximum eigenvalue Amax,o,Af of Vq*^ is bounded. Then 

^0,N^O,N ^0,N ^ T 

^max,0,Af 

and lim sup^ log /C]* ^ = 00 if lim sup HscatH^ = 00. Noting that limsup^ ||so,Ar||^ = 00 
if and only if lim sup ||sAr|p = 00, we have shown that by SOS skeptic can weakly force 

limtrVAr<cxD ^ limsup 11 Sa? 11^ < 00. 

N N 
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Now consider the second case i^f fl On En fl Ei 



log tr Vat 
lim — — = 

N HVn 



always holds. Also on l~l 



hmsup- — < 00 where VQfl[aj^) = } — — — 

N logtr Vn l + ay-Xn 



Therefore on E^ H Ei 



lim^^M^ = 0. 

N tr Vat 



Also ^ 

tr(K)*Ar - Vo,o(a^)) < — trVAT, 

Co 

and hence on E2 fl Ei 

tr^,*^ tr\/o,o(a^)+tr(l^o>-^o,o(a^)) ^ 1 
lim sup — — — = lim sup — < — . 

AT tr Vat at tr Vat Cq 

Now on the right-hand side of (|T8l) . for every ,^ G H i?i there exists Nq = Nq{^) 
such that for all n > Nq 

Hence if for this ^ 

He l|2 

hm sup — — — — = 00 

AT tr Vn log tr 

then lim sup log /C^ ^ = 00 in view of Lemma 13.31 However on E2 the following two events 
are equivalent: 

He H2 He H2 

V Po,Ar SAf 

iimsup ^ = 00 -v^ hmsup = 00. 

N tr Vn log tr Vat at tr Vn log tr Vn 

This completes the proof of Theorem 12.11 



3.4 Better approximation to the capital process of SOS 

Note that f|T3l) is convenient because it gives an upper bound which always holds. However 
bounding by $„(a*) — <l>„(a*_]^) < in f|T2l) is not very accurate. By expanding 
at a = a* and by noting 9<1>„(q;*) = 0, we have 

A$„ = ^Aa:'ln{a:)Aa:, = 9a*^_^ + (1 - ^X, < < 1, (19) 
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where /n(a) = Vo,n(a, a) is a. d x d positive-definite matrix given by 

n 

i=— no+l 

Comparing (fT9l) with the right-hand side of (fT2l) . we see that the upper bound in (fT2|) is 
about twice the actual value of A$„. Now by Lemma [XT] and ([H]), we can approximate 
A$„ as 



■ n 

AT- 1-1 I ^n. ( t-^'r- 

A$„ ~ - log 



2 

Then accumulated these sum is approximated as 

N ^ N , :r / . 



1 lr('*^l 1 I 

n=l n=l ' \ ;w I I 



4«) 



(20) 



Hence from (IE]), (ED and ([20]) we obtain 

TV 



logKl^ = log£^ - ^ A<l>„ - <l>o,o(aS) ~ iVD((7^||(7;;,) - ilog [J^j 

n=l 



The above result is summarized in the following theorem. 

Theorem 3.1. The log capital of the sequential optimizing strategy is approxi- 

mated as 

1 ^ \T ( *\\ 

\oglCl^r^ND{g^U^)--\og[lMl [/Tv] = n i ?" r (21) 



n=l 



Here we note that the quantity |/„(a*)| also appeared in the evaluation of Cover's 
universal portfolio [3] in the name of sensitivity (curvature, volatility) index. Differently 
from the form [Jtv] in SOS, only the last term \I]^{a*^)\ enters in the sensitivity index. 
This difference reflects the fact that SOS depends on the intermediate moves of Reality's 
path = xi ■ ■ -xni whereas the universal portfolio is independent of them. 

We found that the approximation (|2T]) is extremely accurate in practice (cf. Section 
E]). Thus we propose to use this approximation as an information criterion for selecting 
betting items. Let us denote the betting game with d items by Game{d), and suppose 
that there is a sequence of nested betting games such that 

Game{l) C Game{2) C ■ ■ ■ C Game{d). 

We also write the main terms of (|2T1) in Game{d) as 

log/Ct,jv(c?) ~ ND.igM) - ^log [ImU- 
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As functions of d, Dd{gN\\gN) increases monotonically and log [lN]d is also expected to 
increase monotonically (cf. Section [6]). Hence due to the trade-off between DdigNWdN) 
and log [lN]d with respect to d, we can expect that maX]^<^<jlog/C^ ^(rf) provides the 
optimal number d* of betting items. Including this subject, we will examine the obtained 
results by numerical examples in Section O 

Finally we give a brief proof of Theorem I2.2[ The point of the proof is to show that 
a^f ^ on E'. 

Proof of Theorem \2.B. E' in ([7]) holds only if Amin^Ar — >• oo. Then by f|T7|) and f|T8l) we 
have ^ 

Note that log | Vat | < d log Amax, Af • Therefore if lim sup > then lim sup^y n = ^ • 
This shows that conditional on E' Skeptic can weakly force the event — > 0. 
However when 0, for all sufficiently large we can approximate 

1 ^ 1 

H(^n) - ^'^nVn^sn, ^A$„ ~ -log|V]v|. 

n=l 

Since log \Vn\ — > cxd on E', if hmsup^ s)yVj^^SN/ log |VAr| > 1 then limsup^ logK^ = oo. 
Therefore conditional on E', by SOS Skeptic can weakly force lim sup^ s^Vj^'^sn/ log | Va^I < 
1. □ 



4 High frequency limit order SOS in multiple asset 
trading games in continuous time 

In this section we generalize the results of [12] to the multi-dimensional case and apply 
SOS as a high-frequency limit order type investing strategy to multiple asset trading games 
in continuous time. We follow the notation and the definitions in [12]. For simplicity of 
statements we make convenient assumptions and only present salient aspects of SOS. 

Let Q'^ denote the set of ci-dimensional (component- wise) positive continuous functions 
on [0, oo). Market (Reality) chooses an element S{-) G fi*^. Investor (Skeptic) enters the 
market at time t = = with the initial capital of /C(0) = 1 and he will buy or sell any 
amount of the assets S{t) = (S^it), . . . , S'^(t)y at discrete time points = to < < ^2 < 
■ ■ ■ , provided that his capital always remains non-negative. His repeated tradings up to 
time ti determine Mj = (M/, . . . , MfY G M*^, where M/ denotes the amount of the asset 
S^{t) he holds for the time interval [tj,tj+i). Let IC{t) denote the capital of Investor at 
time t, which is written as 

IC{t) = IC{U) + M, ■ {S{t) - Siti)) for U<t< U+i, (22) 

with /C(0) = 1. By defining 
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we rewrite ( !22l) as 



]C{t) = 1C{U) 1 + a 



Sit) - S{U 
S{U) 



for ti <t < tj+i 



in terms of the returns of the assets given by 

Sit) - S{t,) fS\t) - S\t,) S'^it) - V 



S{ti 



S'{t, 



s^{t. 



Investor takes some constant 6 > and decides the trading times ti,t2, • • • by the 
"hmit order" type strategy as follows. After ti is determined, let tj+i be the first time 



after ti when 



5(t.+i) - Sit,) 



Sit, 



(23) 



happens. This process leads to a discrete time bounded forecasting game embedded into 
the asset trading game in the following manner. Let 



i-^ni ■ ■ ■ 1 -^n) ^ ^<5) •^n 



s^it 



n+l) 



sKu 



S^itr 



where Cs denotes the sphere of radius 5 in given by (!23l) . and also write /C„ = /C(t„+i). 
Then we have the protocol of an embedded discrete time bounded forecasting game. 

Embedded Discrete Time Bounded Forecasting Game 
Protocol: 

/Co := 1, (5 > 0. 
FORn= 1,2,...: 

Investor announces a„ G W^. 
Market announces e C^. 

K.n = /Cn-l(l + an " Xn). 

END FOR 



We now fix T > 0, and Investor trades in the time interval [0,T] by SOS in (jlj). For 
A > let 

Ea,o,t = {S en'' I |log^^(x)-log^^(i/)|<A 3jG{l,...,4, 0<Vx<Vy<T}. 

Market is assumed to choose 5'(-) G E\qj.^ which means that all d items are active in 
some time interval in [0,T]. We define N = A^(T, 5, 5'(-)) by tiv < T < ^at+i. Note that 
by taking 6 sufficiently small, 

NiT,6,Si-))>j 
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for every S{-) G -E^qT' ^^^^ N —>■ oo a.s 6 ^ 0. Investor's capital }Cs{T) at t = T is 
written as 

/C5(i ) = /Ci jv + "jv-1 J • 



Since 



SiT)-S(tN) 
5(ijv) 



< 5, we have from (l^Tj) 



log/C5(r) = log/Ct,^ + 0(1) ~ iVZ}((?;v||(?^) - - log [In]. 



(24) 



The strategy (fTOj) is written as = a^(r, 5, S'(-)) = Vqj^^Sq^n- We now assume (cf. 
Theorem 12. 2p that ^ as 5 ^ 0, i.e., Market chooses a path S{-) G -E^, where 



= {S{-) G I lim (5a^(r, 5, ^(0) = 0}. 



Then 



a 



N 



N 

E 

n=— no+l 



AT 



where 



N 



(1 + 0(5)) = V,-UL{T) + -vo,n){1 + 0{6)) 



n=— no+l 



N 



N 



[X. 



d\2 



Vo,N = ^0'^ " ( 5Z ■ ■ ■ ' 

n=— no+l n=— no+l n=— no+l 

L(T) = log5(T)-log5(0). 
We consider the first term ND^g^Wglf) in (!24l) . As was indicated by (fTSl) . 

iVD(^jvlb^) = i«;JK,>^(l + 0(5)) = ^«^V^o,7v«^(l + 0(5)) 



L{T)%-}L{T) + -{L{T)%-^vo,N + vl^V,-^L{T)) 
+ ^47vV^o>o,7v] (1 + 0(5)). 



(25) 



The middle term is dominated by the first term and the third term by Cauchy-Schwarz: 



\L{T)%-^Vo,N + vl^V-^L{T)\ < 2^L{T)W-}L{T)^vl^V-}vo,N • 

Thus we consider the behavior of the first term and the third term. Because Cs is the 
sphere of radius 5 we have 

trV/v = tiDN = N5'^, 



where 



N N N 

VN = Y^nxl /^^ = diag [Y.^xl)\...,Y.^xif)- 



n=l 



n=l 



n=l 
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Also the training data are of order 6. Hence trVo^Af — trViv = trDo,Af — tiDisi = 0{6^] 
Let us decompose Vq^n and Vq^n as 

yo,N = -Do,'jV-^0,Af-Do,'jV' ''^0,N = Dq nI^, 1^ = {1, . . . , 1)*, 

N N 

n=— no+l n=— no+1 

where -Ro,Ar is the correlation matrix in {x^, . . . , x^}, n = —no + 1, . . . , A^. Then 



1 



AT, 



because the maximum eigenvalue of -Ro.Af is less than or equal to d. 

Suppose that the Holder exponent of S{-) is < < 1 in the sense that 

Si-) e En,T = {Si-) I < hminf < limsup < oo}. 

By combining the arguments so far, if Si-) G -^aot ^ ^'t ^ Eh,t then the following 
implications hold: 

H >0.5 trDN ^ ^ LiT)%-^LiT) oo, 

if < 0.5 =^ tl D j\f ^ oo =^ "Wq ArV^~^fo,Ar ^ oo. 

Also it is easily shown that the second term | log [/at] in f l24l) is of smaller order than 
NDigN\\g^). We summarize our result as a theorem, which is a mult i- dimensional gen- 
eralization of Theorem 3.1 in 1121. 



Theorem 4.1. By a high frequency (5 — 0) limit order type sequential optimizing strategy 
in multiple asset trading games in continuous time, Investor can essentially force H = 0.5 
for Si-) E -E^oT sense 

Si-) e E'X q j, nE'^n Eh,t and H ^0.5 JCsiT) ^ oo as 5^0. 



5 Generality of high frequency limit order SOS 

In this section we show a generality of the high-frequency limit order SOS developed in the 
previous section, which implies that when the asset price Sit) follows the vector-valued 
geometric Brownian motion, our strategy automatically incorporates the well-known con- 
stant proportional betting strategy originated with Kelly ([7j) and yields the likelihood 
ratio in the Girsanov's theorem for geometric Brownian motion. The convergence results 
in this section are of measure-theoretic almost everywhere convergence. 
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When S{t) is subject to the d-dimensional geometric Brownian motion with drift vector 
H and non-singular volatihty matrix a, 



L{T) 



^,--a']T + aW{T), 



where W{-) denotes the rf-dimensional standard Brownian motion, and cr^ denotes the 
(i-dimensional vector with the diagonal elements of aa^. In this section we let T — >■ oo 
and also let 5 = 5^ ^ in such a way that | log^-rl = o{-\/T). We have 



and hence we can evaluate 



a 



N 



Vo,N = {(rcy')T{l + 0{5T)) 
a-i)W(T) 



T 



1 + 0{6t)). 



(26) 



The first term in the right-hand side of (!26|) is the constant vector, which is derived also 
from the so-called Kelly criterion of maximizing i?[log /C(T)]. 

Next consider N D{g]\j\\g*j^) in (l24l) . which was also indicated by ( l25l) . 



ND{gn\\gN) = 2«;^^o,7va^(l + 0{5t)) 

^^^\aaT'f^ + liia-'f^yWiT) + W(T)*(a-V))] (1 + 0{5t)). 
The log capital (12^ is then expressed as 

logJCsAT) = [^((a-V)W(T) + l^(T)*(a-V)) + ^f^\aaT'^^ 



--logT + log^T 
Hence the main terms on the right-hand side 



(1 + 0(5t)) + 0(1). 



- log /C(T) = -^{{a-'f^fW{T) + W{T)\a-'f^)) - ^ ^\aa')-' + o{Vf) 

provide the likelihood ratio of the unique martingale measure known as the Girsanov's 
theorem in multiple assets case, and we obtain 



lim 



log/C(T) 
T 



1 



(27) 



Finally we discuss mutual information quantities among subgames of the multi-dimensional 
bounded forecasting game. Let us denote the quadratic form in the right-hand side of 
m by 



Q{S)=QiS\...,S'') = ^fi\aayf^, 



{2i 
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which designates the optimal exponential growth rate of Investor's capital process with d 
joint betting items S = {S^, . . . , S'^). We partition S into the following form 

= iS^\ . . . , ^[2] = iS^'^^\ • • • , S^'^), • • • , = iS^'-^+\ . . . , 5^-^™), 

and assume that Investor is allowed to trade the above m groups of joint sub-betting 
items successively during the one period of the d joint trading. Then the corresponding 
optimal exponential growth rate of Investor's capital process becomes 

Q(5[i]) + Q(5[2]) + --- + Q(V])- (29) 

Note that among fl25]) and fl2^ for all possible partitions there is no general dominance 
relations and this argument leads to the notion of mutual information quantity between 
betting games, which will be treated in a forthcoming paper. 



6 Numerical examples 

In this section we give some numerical examples on the stock price data from the Tokyo 
Stock Exchange. The data are daily closing prices from January 4th in 2000 to March 
31st in 2006 for several Japanese companies listed on the first section of the TSE. There 
are T = 1536 daily closing prices. 

From this data we construct the bounded forecasting game in the following manner. 
At first the daily returns si = {S-l_^_-^ — Si)/ t = 1, . . . , T — 1, j = 1, . . . ,d oi d items 
are transformed to [—1, 1] by 

— - C*^ 

j ^'-^t t —t r -1 -1 1 —i i i ' i 

zi = : : G — 1 , 1 , si = max si, si = mm si . 

* - si L ' J> t ^^f^r-i *' -* ^<t<T-^ * 



5-; _ 5- l<t<T-l l<t<T-l 



Next 2*^ training data Zf = (±1, . . . , ±1)*, t = 1, . . . 2^^, and a forecasting time F = cT, < 
c < 1 are prepared, and forecasting value for the j-th component is 

~'~ t=i t=i 

Then the bounded variables x„ = (x^, . . . , x^)* in the protocol are introduced as 



zi- p^, l<n<2° 



zi_o,^p-p^, 2^<n<N = 2'' + T-l-F. 



Figures 1-5 and Figures 6-10 exhibit the cases of three items Takeda, Toyota, Kirin 
with F = 0.17T and F = 0.25T, respectively. The notations in the figures are as follows 
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and their final values at the end of round N are indicated in the figures. 




K = exp(nL)(^„||^*)) 



n 



1 





GR, 



LD, 



n 



■n 



1 



As suggested in Section 13.41 and K^, LK^ and LK^, LD\ and LDf^ are almost 
overlapped in the figures. We can also see that the actual log deficiency LD\ or LD"^ is 
far less than LD^ which is the typical log deficiency in the case of finite items such as 
in the horse race game. Furthermore Figures 5,10 show that the deficiency rate process 
DRn gives the precise convergence border rate for the growth rate process GRn or its 
approximated quadratic rate process QRn- 

Figures 11-16 illustrate the cases of composite games 



with five items 1. Takeda, 2. Toyota, 3. Kirin, 4. Tepco, 5. NNK in this order. As expected 
the following trade-off can be seen in the figures. 



Hence the choice of the three items 1. Takeda, 2. Toyota, 3. Kirin is the most profitable 
one in the above composite games. 

Figures 17-20 compare the sequential optimizing strategy with the universal portfo- 
lio for one item Takeda, Toyota, Kirin, an imaginary data, respectively. The universal 
portfolio in its simplest form with one item can be performed in the following way. 

Divide the closed interval A = {a G M | l + ax > 0, Vx e D} of prudent strategies into 
disjoint subintervals Ai, . . . , Am- Then for the m-th account Am with the initial capital 
/Cg™"* = 1/M, Skeptic continues the game with constant betting ratio am G A^, m = 
1, . . . , M. His capital at the end of round n is expressed as /C^ = X]m=i ^rT^ ■ The figures 
are the cases with M = 100 and the notations are 

i^^" = /C^ without the training data {—1, 1}, 
i^^i = /C^ with the training data {-1, 1}. 

Figures 20-22 show the case of an imaginary data given by 



Game{l) C Game{2) C Gamei?,) C Game{A) C Game{5) 



LKl : Gil) <G{2) <G(3) 
LDl : G(l) < G(2) < G(3) 
LKl : G{1) <G{h) <G(2) 



< G(4) < G(5) , 

< ^(4) < G(5) , 

< G{A) < G{3) . 



1 



n + l 



n = 1, ...,2000. 



20 



In this case LK^ ~ a\ogn — c, < a < 1, c > 0, which contrasts with the case of 
coin-tossing game LK^ ~ nD{xn\\p) — \ logn. 

Figures 17-20 suggest that there is no general superiority between the sequential op- 
timizing strategy and the universal portfolio. 

7 Some discussions 

In this paper we proposed a sequential optimizing strategy in multi-dimensional bounded 
forecasting game and showed that it is a very flexible strategy. From a theoretical view- 
point it allowed us to prove a generalized form of the strong law of large numbers. From 
a practical viewpoint the strategy is easy to implement even in high dimensions and its 
performance is competitive against universal portfolio. 

Theoretical comparison of our strategy with universal portfolio needs more detailed 
asymptotic investigation of the capital processes of these strategies. This is left to our 
future research. 

In Section H] as a limit order type strategy we considered successive stopping times 
defined by a sphere of radius b for the vector of returns (cf. fl25]) ). which is based on the 
standard Euclidean norm in R'^. We note that other boundaries based on other norms 
which are equivalent to the standard one provide the same result stated in Theorem 14. 1[ 

Theorem 12. II for the case of supjy Vat < oo does not provide a game-theoretic version of 
Kolmogorov's three series theorem. It only implies that S'at, = 1, 2, . . . , are bounded. 
However we expect that a game-theoretic version of Kolmogorov's three series theorem 
can be established by appropriate modification of our strategy. This topic is also left to 
our future research. 



A A convergence lemma 

Let Ml, M2, . . . be a sequence of points in W^. We assume that they are bounded: < 1, 
Vn, and that Ui, . . . ,Ud are linearly independent. Define 

Then we have the following lemma. It is trivial iox d= 1, but for > 1 we need a careful 
argument. 

Lemma A.l. 

^ 0, (n^oo). 

Proof. We first show that y„ is bounded. Let \min,d > denote the minimum eigenvalue 
of Uiu\ + ■ ■ ■ + UdU^a- Then all the eigenvalues of Uiu\ + ■ ■ ■ + Unul^, n > d, are greater 
then equal to Amin,d- Then all the eigenvalues of {uiu\ + ■ ■ ■ + UnuD'"^ are less than or 
equal to A~^j^ ^. Hence 

WynW < Ajn,Jknir (30) 
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Figure 1 : Closing prices of Takeda, Toyota, 

Kirin F = 0.17T 
Figure 2 : Capital processes 

-"-n' ^^n 

Figure 3 : Log capital processes 
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Figure 4 : Log deficiency processes 
LDl LDl LDl 

Figure 5 : Rate processes 
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Figure 3: Log capital processes 
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Figure 6 : Closing prices of Takeda, Toyota, 

Kirin F = 0.25T 
Figure 7 : Capital processes 
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Figure 8 : Log capital processes 
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Figure 9 : Log deficiency processes 
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Figure 10 : Rate processes 
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Figure 8: Log capital processes 
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Figure 13: Capital processes K'^ 
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Figure 14: Capital processes Kj^ 
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Figure 15: Log capital processes LK'^ 



Figure 16: Log capital processes LK^^ 
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and ?/„, = 1, 2, . . . , are bounded. 

Now we argue by contradiction. Suppose that = 1, 2, . . . , do not converge to 

zero. Then there exists a subsequence n^, k = 1,2, . . . such that —>■ a ^ 0, {k ^ cxd). 
In view of fISUl) . if Un,. — > then ^ 0, which is a contradiction. Therefore 
/c = 1, 2, . . . , do not converge to 0. Then there exists a further subsequence {uk} C {n^} 
such that Mfi^ — > 6 7^ 0. Then y^ij. — a, M^i^ — * 6. Consider 

Then 



frnm fVip Ipft wp Viavp 



Multiplying by y^^ from the left we have 



Now the left-hand side is written as 

{yl.uif + ■ • ■ + [yl^Un^.if. 

Note that for sufficiently large k,k', {ii\^Un^,Y are all close to (6*a)^. Since we have 
infinitely many such terms, the left-hand side diverges to oo if 6* a 7^ 0. This contradicts 
the fact that the right-hand side converges to a finite value. Therefore h^a = 0. But then 

\immi{yluif + ■■■ + {ylu^,-if > (ylu,)^ + ■■■ + {ylu^f 
(a*Mi)2 + ■ ■ ■ + (a^Udf > 0, 

which is again a contradiction. □ 

We also present the following corollary of the above lemma. 
Corollary A.l. With the same notation and conditions as in Lemma \3.1\ 

yn = {uiu\ + U2u\ H ^ Un-iu\_^)~^/'^Un -^0, (n oo). 

This corollary follows easily from the fact that H^nlP = u^jjn and m„ is bounded. 

Based on the above corollary we give a proof of Lemma 13.11 Before going into the 
proof, we summarize some facts on matrix inequalities. For a symmetric matrix A, let 
A > mean that A is positive definite, li A> B > Q, then E"^ > A~^ > (Lemma 4.2 
of [2]). Note that A > B > Q does not imply A^ > B'^ (e.g. Chapter 1 of [H]), which 
complicates our proof. 

Proof of Lemma \3.1\ By the definition of Ci in (ITSl) we have 

Vb,n-l(a*_l,0 > ^V'o,n-l(0,0), 
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where Vo,n-i(0, 0) = J2^=-no+i positive definite because of the training data. Write 

A< = 'K),n--l«_l,an)~^^Vo,„_i«_i,0-^/V«-l)- 

Then 

II . .||2 ^ a:„«)Vo,„_i«_i,0-^x„«) 

l|A"nll < 1 f-* n 5 

^min,0,n— 1 l^Cln— 1 ' '^n/ 

where Amin,o,n-i(an_i, a^) is the minimum eigenvalue of Vo,n-i(an_i, Let Amin,o,o 

denote the minimum eigenvalue of Vo,o- Then Xmm,o,n-i{c(n-i^ (^n) — '^mm,o,o/C'i for all 
77, > 1 and 

||A<f < - — ^x„«)*\/o,„_i«_i,0~V„«). 

^mm,0,0 

For n > 1, 1 + a* ■ x„ > eo- Hence 

Co^min.CO £o^min,0,0 

The right-hand side converges to by Corollary ISH □ 
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